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Abstract 



We study the average consensus problem of multi-agent systems for general network topologies with 

(N 

unidirectional information flow. We propose two (linear) distributed algorithms, deterministic and gossip, 
respectively for the cases where the inter-agent communication is synchronous and asynchronous. Our 
contribution is that in both cases, the developed algorithms guarantee state averaging on arbitrary strongly 
connected digraphs; in particular, this graphical condition does not require that the network be balanced 
or symmetric, thereby extending many previous results in the literature. The key novelty of our approach 
^/ ', is to augment an additional variable for each agent, called "surplus", whose function is to locally record 

^ , individual state updates. For convergence analysis, we employ graph-theoretic and nonnegative matrix 

tools, with the eigenvalue perturbation theory playing a crucial role. 



This paper presents a new approach to the design of distributed algorithms for average consensus: 



> 

CO ■ I. Introduction 

in 

(N 

fT) | that is, a system of networked agents reaches an agreement on the average value of their initial states, 

o 

CN) ' through merely local interaction among peers. The approach enables multi-agent systems to achieve 

average consensus on arbitrary strongly connected network topologies with unidirectional information 

k>( ■ flow, where the state sum of the agents need not stay put as time evolves. 

There has been an extensive literature addressing multi-agent consensus problems. Many fundamental 
distributed algorithms (developed in, e.g., CD-El) are of the synchronous type: At an arbitrary time, indi- 
vidual agents are assumed to sense and/or communicate with all the neighbors, and then simultaneously 
execute their local protocols. In particular, Olfati-Saber and Murray [3] studied algorithms of such type 
to achieve average consensus on static digraphs, and justified that a balanced and strongly connected 

The authors are with the Department of Computational Intelligence and Systems Science, Tokyo Institute of Technology, 4259- 
J2-54, Nagatsuta-cho, Midori-ku, Yokohama 226-8502, Japan. Phone/Fax: +81-45-924-5371. Emails: caikai@sc.dis.titech.ac.jp, 
ishii@dis.titech.ac.jp. This work was supported in part by the Ministry of Education, Culture, Sports, Science and Technology 
in Japan under Grant-in-Aid for Scientific Research, No. 21760323. 



topology is necessary and sufficient to guarantee convergence. More recently in J6], Boyd et al. proposed 
a compelling "gossip" algorithm, which provides an asynchronous approach to treat average consensus. 
Specifically, the algorithm assumes that at each time instant, exactly one agent wakes up, contacts only 
one of its neighbors selected at random, and then these two agents average out their states. The graph 
model that the algorithm bases is undirected (or symmetric), and average consensus is ensured as long as 
the topology is connected. Since then, the gossip approach has been widely adopted |7]-|[9j in tackling 
average consensus on undirected graphs, with additional constraints on quantized information flow; see 
also ifTOl for related distributed computation problems in search engines. 

In this paper, and its conference precursor ITTTI . we study the average consensus problem under both 
synchronous and asynchronous setups, as in |]3j and J6]. In both cases, we propose a novel type of 
(linear) distributed algorithms, which can be seen as extensions of the corresponding algorithms in 
and O; and we prove that these new algorithms guarantee state averaging on arbitrary strongly 
connected digraphs, therefore generalizing the graphical conditions derived in [3] and [6]. We note that 
digraph models have been studied extensively in the consensus literature J3]-||5], and considered to 
be generally more economical for information exchange than their undirected counterpart (refer to El 
for more detailed motivation of using digraphs). Our underlying (theoretic) interest in this paper is to 
generalize the connectivity conditions on digraphs for average consensus. 

The primary challenge of average consensus on arbitrary strongly connected digraphs lies in that the 
state sum of agents need not be preserved, thereby causing shifts in the average. We note that there are a 
few efforts in the literature having addressed this issue. In lfT2l . an auxiliary variable is associated to each 
agent and a linear broadcast gossip algorithm is proposed; however, the convergence of that algorithm is 
not proved, and remarked to be difficult. References lfl"3~l . lTT4l also use extra variables, and a nonlinear 
(division involved) algorithm is designed and proved to achieve state averaging on non-balanced digraphs. 
The idea is based on computing the stationary distribution for the Markov chain characterized by the agent 
network, and is thus quite different from consensus-type algorithms 0, [0. In |[Q Section 7.4], the load 
balancing problem is tackled in which inter-processor communication is asynchronous and with bounded 
delay. The underlying topology is assumed undirected; owing to asynchronism and delay, however, the 
total amount of loads at processors is not invariant. A switched linear algorithm is proposed to achieve load 
balancing in this scenario, the rules of which rely on however bidirectional communication. In addition, a 
different and interesting approach is presented in lil"5l : Given a general strongly connected digraph, find a 
corresponding doubly stochastic matrix (which, when used as a distributed updating scheme, guarantees 
state averaging [|4]])- An algorithm is designed to achieve this goal by adding selfloop edges with proper 



weights to balance flow-in and -out information. Finally, time-varying state sum caused by packet loss or 
communication failure is considered in lfl6l . |H71 . and the deviation from the initial average is analyzed. 

We develop a new approach to handle the problem that the state sum of agents need not be preserved. 
Similar to |[T2l . we also augment an additional variable for each agent, which we call "surplus"; different 
from |[T3l , Ifl4l . the function of surplus variables is to record every state change of the associated agent. 
Thus, in effect, these variables collectively maintain the information of the average shift amount^ Using 
this novel idea, our main contribution is the design of linear algorithms (without switching) to achieve 
average consensus on general strongly connected digraphs, in contrast with the types of algorithms 
designed in lfT3l . |[T4l and [Q Section 7.4]. Also, linearity allows us to employ certain matrix tools 
in analysis, which are very different from the proof methods used in lTl3l . |[T4l and [Q Section 7.4]. 
Moreover, our technical contribution in this paper is the demonstration of matrix perturbation tools 
(including eigenvalue perturbation, optimal matching distance, and Bauer-Fike Theorem Il20l - ll22l ) in 
analyzing convergence properties, which seems unexplored in the consensus literature. 

Our idea of adding surpluses is indeed a continuation of our own previous work in ||23l , where the 
original surplus-based approach is proposed to tackle quantized average consensus on general digraphs. 
There we developed a quantized (thus nonlinear) averaging algorithm, and the convergence analysis is 
based on finite Markov chains. By contrast, the algorithms designed in the present paper are linear, and 
hence the convergence can be characterized by the spectral properties of the associated matrices. On the 
other hand, our averaging algorithms differ also from those basic ones Q, in that the associated 
matrices contain negative entries. Consequently for our analysis tools, besides the usual nonnegative 
matrix theory and algebraic graph theory, the matrix perturbation theory is found instrumental. 

The paper is organized as follows. Section |TT] formulates distributed average consensus problems in 
both synchronous and asynchronous setups. Sections UlTI and HVl present the respective solution algorithms, 
which are rigorously proved to guarantee state averaging on general strongly connected digraphs. Further, 
Section IVl explores certain special topologies that lead us to specialized results, and Section IVil provides 
a set of numerical examples for demonstration. Finally, Section IVIII states our conclusions. 

Notation. Let 1 := [1 • • • 1] T G M n be the vector of all ones. For a complex number A, denote its real 
part by Re(A), imaginary part by Im(A), conjugate by A, and modulus by |A|. For a set S, denote its 

'The method of augmenting auxiliary variables is also found in 1181 and 1191 , as predictors estimating future states and shift 
registers storing past states respectively, in order to accelerate consensus speed. How the predictors or registers are used in these 
references is, however, very different from our usage of surpluses. 



cardinality by card(5). Given a real number x, [x\ is the largest integer smaller than or equal to x, and 
\x~\ is the smallest integer larger than or equal to x. Given a matrix M, \M\ denotes its determinant; the 
spectrum a(M) is the set of its eigenvalues; the spectral radius p(M) is the maximum modulus of its 
eigenvalues. In addition, || • H2 and || • ||oo denote the 2-norm and infinity norm of a vector/matrix. 

II. Problem Formulation 

Given a network of n (> 1) agents, we model its interconnection structure by a digraph Q = (V,£): 
Each node in V = {l,...,ra} stands for an agent, and each directed edge (j,i) in £ C V x V denotes 
that agent j communicates to agent i (namely, the information flow is from j to i). Selfloop edges are 
not allowed, i.e., (i,i) ^ £ . In Q a node i is reachable from a node j if there exists a path from j to 
i which respects the direction of the edges. We say Q is strongly connected if every node is reachable 
from every other node. A closed strong component of Q is a maximal set of nodes whose corresponding 
subdigraph is strongly connected and closed (i.e., no node inside the subdigraph is reachable from any 
node outside). Also a node i is called globally reachable if every other node is reachable from i. 

At time k G Z + (nonnegative integers) each node i 6 V has a scalar state Xi(k) G M; the aggregate 
state is denoted by x(k) = [x\(k) ■ ■ ■ x n (k)] T G M. n . The average consensus problem aims at designing 
distributed algorithms, where individual nodes update their states using only the local information of 
their neighboring nodes in the digraph Q such that all Xi(k) eventually converge to the initial average 
x a := 1 x(0)/n. To achieve state averaging on general digraphs, the main difficulty is that the state sum 
\ T x need not remain invariant, which can result in losing track of the initial average x a . To deal with 
this problem, we propose associating to each node i an additional variable Si(k) G K, called surplus; 
write s(k) = [si(k) ■ ■ ■ s n (k)] T G M. n and set s(0) = 0. The function of surplus is to locally record the 
state changes of individual nodes such that l T (x(k) + s(k)) = l T x(0) for all time k; in other words, 
surplus keeps the quantity l T (x + s) constant over time. 

In the first part of this paper, we consider synchronous networks as in 0: At each time, every node 
communicates with all of its neighbors simultaneously, and then makes a corresponding update. 

Definition 1. A network of agents is said to achieve average consensus if for every initial condition 

(x(0),s(0) = 0), it holds that (x(k),s(k)) -> (x a l,0) as k -> 00. 

Problem 1. Design a distributed algorithm such that agents achieve average consensus on general digraphs. 
To solve this problem, we will propose in Section HIT] a surplus-based distributed algorithm, under 
which we justify that average consensus is achieved for general strongly connected digraphs. 



In the second part, we consider the setup of asynchronous networks as in O. Specifically, commu- 
nication among nodes is by means of gossip: At each time, exactly one edge (j, i) G 8 is activated 
at random, independently from all earlier instants and with a time-invariant, strictly positive probability 
Pij G (0, 1) such that J2(j i)esPij = 1- Along this activated edge, node j sends its state and surplus to 
node i, while node i receives the information and makes a corresponding update. 

Definition 2. A network of agents is said to achieve 

(i) mean-square average consensus if for every initial condition (x(0), s(0) =0), it holds that 

E [\\x{k) - a? l||i] -> and E [\\s{k)\\l] -»■ as fc ->■ oo; 

(ii) almost sure average consensus if for every initial condition (x(0), s(0) =0), it holds that 

(x(fe),s(/c)) — > (x a l,0) as k — > oo with probability one. 

As defined, the mean-square convergence is concerned with the second moments of the state and 
surplus processes, whereas the almost sure convergence is with respect to the corresponding sample 
paths. It should be noted that in general there is no implication between these two convergence notions 
(e.g., O Section 7.2]). 

Problem 2. Design a distributed algorithm such that agents achieve mean-square and/or almost sure 
average consensus on general digraphs. 

For this problem, we will propose in Section [TV] a surplus-based gossip algorithm, under which we 
justify that both mean-square and almost sure average consensus can be achieved for general strongly 
connected digraphs. 

III. Averaging in Synchronous Networks 
This section solves Problem 1. First we present a (discrete- time) distributed algorithm based on surplus, 
which may be seen as an extension of the standard consensus algorithms in the literature [H]-|EI- Then 
we prove convergence to average consensus for general strongly connected digraphs. 

A. Algorithm Description 

Consider a system of n agents represented by a digraph Q = (V,£). For each node i G V, let 
J\f+ ■= {j e V : (j, i) G £} denote the set of its "in-neighbors", and A/~ := {h G V : (i, h) G £■} the set 
of its "out-neighbors". Note that A/"j + / M~ in general; and i ^ J\f^ or N~, for selfloop edges do not 
exist. There are three operations that every node i performs at time k G Z + . First, node i sends its state 
information Xi(k) and weighted surplus bih,Si(k) to each out-neighbor h G A/^~; here the sending weight 



bih is assumed to satisfy that bih G (0, 1) if h G A/"~, &ih = if h G V — A/J~, and Y^heJ^~ ^ih < 1- 
Second, node i receives state information Xj(k) and weighted surplus bjiSj(k) from each in-neighbor 
j G A/^ + . Third, node i updates its own state Xi(k) and surplus Si(k) as follows: 

Xj(A; + l) = Xi(k) + ^J aij(xj(k) - Xi(k)) +esi(k), (1) 

s<(fc + 1) = ((1 - ^ &ifc)*»(fc) + ^ ^(fc)) - (xi(k + 1) - ^(fc)) , (2) 

heAf- j£Af+ 

where the updating weight Ojj is assumed to satisfy that Ojj G (0, 1) if j G M^, a,ij = if j G V — A/^~, 
and SjeAf:+ a «j < 1; in addition, the parameter e is a positive number which specifies the amount of 
surplus used to update the state. 

We discuss the implementation of the above protocol in applications like sensor networks. Let Q = 
(V,£) represent a network sensor nodes. Our protocol deals particularly with scenarios where (i) sensors 
have different communication ranges owing possibly to distinct types or power supplies; (ii) communi- 
cation is by means of broadcasting (e.g., |[T2"1 ) which again might have different ranges; and (hi) strategy 
of random geographic routing is used for efficient and robust node value aggregation in one direction 
|[T3l , |[T4l . In these scenarios, information flow among sensors is typically directed. A concrete example 
is using sensor networks for monitoring geological areas (e.g., volcanic activities), where sensors are 
fixed at certain locations. At the time of setting them up, the sensors may be given different transmission 
power for saving energy (such sensors must run for a long time) or owing to geological reasons. Once 
the power is fixed, the neighbors (and their IDs) can be known to each sensor. Thus, digraphs can arise in 
static sensor networks where the neighbors can be fixed and known. To implement states and surpluses, 
we see from (fl}, © that they are ordinary variables locally stored, updated, and exchanged; thus they 
may be implemented by allocating memories in sensors. For the parameter e, we will see that it plays 
a crucial role in the convergence of our algorithm; however, e must be chosen sufficiently small, and a 
valid bound for its value involves non-local information of the digraph. The latter constraint (in bounding 
a parameter) is often found in consensus algorithms involving more than one variable ||5), ||25l , ||2"6l . 
One may overcome this by computing a valid bound offline, and notify that e value to every node. 

Now let the adjacency matrix A of the digraph Q be given by A := [<2jj] G M nxn , where the entries are 
the updating weights. Then the Laplacian matrix L is defined as L := D—A, where D = diag(di, . . . , d n ) 
with di = Y^rj=i a ij- Thus L has nonnegative diagonal entries, nonpositive off-diagonal entries, and zero 
row sums. Then the matrix I — L is nonnegative (by ^7gaT + a v < 1)> anc ' ever y row sums up to 
one; namely / — L is row stochastic. Also let B := [bih] T G M nxn , where the entries are the sending 



M+ = {4} A/f = {2,3} 

M} = {1,3,4} jVf = {4} 

^ = {1,4} A^ = {2,4} 

A/" 4 + = {2,3} A/f = {1,2,3} 

Fig. 1. Illustrating example of four agents: communication topology and neighbor sets. 




weights (note that the transpose in the notation is needed because h G J\f~ for bih)- Define the matrix 
S := (I — D) + B, where D = diag(di, . . . ,d n ) with di = Y^h=i^ih- Then S is nonnegative (by 
Y^heAf' bih < 1)> and every column sums up to one; i.e., S is column stochastic. As can be observed 
from ©, the matrix S captures the part of update induced by sending and receiving surplus. 
With the above matrices, the iterations (Q3 and © can be written in a matrix form as 



x(k + 1) 
s(k + 1) 



M 



x(k) 
s(k) 



where M 



I - L el 
L S-el 



2nx2n 



(3) 



Notice that (i) the matrix M has negative entries due to the presence of the Laplacian matrix L in the 
(2, l)-block; (ii) the column sums of M are equal to one, which implies that the quantity x(k) + s(k) is 
a constant for all k > 0; and (hi) the state evolution specified by the (1, l)-block of M, i.e., 



x{k + l) = (I-L)x(k), 



(4) 



is that of the standard consensus algorithm studied in the literature (e.g., jT|, |f3l, (H). We will henceforth 
refer to (J3j as the deterministic algorithm, and analyze its convergence properties in the next subsection. 

Example 1. For an illustration of the algorithm d3), consider a network of four nodes with neighbor 
sets shown in Fig. [TJ Fixing i e [1,4], let a^- = 1/ (card(A/^ + ) + l) for every j E N^ and 6^ = 
1/ (card(A/^~) + l) for every h G N[~ . Then the matrix M of this example is given by 



M 



1/2 








1/2 


e 











1/4 


1/4 


1/4 


1/4 





r 








1/3 





1/3 


1/3 








c 








1/3 


1/3 


1/3 











e 


1/2 








-1/2 


1/3 -e 








1/4 


-1/4 


3/4 


-1/4 


-1/4 


1/3 


1/2 -e 


1/3 


1/4 


-1/3 





2/3 


-1/3 


1/3 





1/3 -e 


1/4 





-1/3 


-1/3 


2/3 





1/2 


1/3 


1/4 -e 



We see that M has negative entries, and every column sums up to one. 



B. Convergence Result 

The following is a graphical characterization for the deterministic algorithm © to achieve average 
consensus. The proof is deferred to Section IIII-CI 

Theorem 1. Using the deterministic algorithm © with the parameter e > sufficiently small, the agents 
achieve average consensus if and only if the digraph Q is strongly connected. 

Without augmenting surplus variables, it is well known © that a necessary and sufficient graphical 
condition for state averaging is that the digraph Q is both strongly connected and balanced^ A balanced 
structure can be restrictive because when all the weights a-ij are identical, it requires the number of 
incoming and outgoing edges at each node in the digraph to be the same. By contrast, our algorithm © 
ensures average consensus for arbitrary strongly connected digraphs (including those non-balanced). 

A surplus-based averaging algorithm was initially proposed in f23l for a quantized consensus problem. 
It guarantees that the integer- valued states converge to either \x a \ or \x a ~] ; however, the steady-state 
surpluses are nonzero in general. There, the set of states and surpluses is finite, and thus arguments of 
finite Markov chain type are employed in the proof. Distinct from ll23l . with the algorithm © the states 
converge to the exact average x a and the steady-state surpluses are zero. Moreover, since the algorithm 
© is linear, its convergence can be analyzed using tools from matrix theory, as detailed below. This last 
linearity point is also in contrast with the division involved algorithm designed in |[T3l . lTT4l . 

The choice of the parameter e depends on the graph structure and the number of agents. In the following, 
we present an upper bound on e for general networks. 

Proposition 1. Suppose that the digraph Q is strongly connected. The deterministic algorithm © achieves 
average consensus if the parameter e satisfies e G (0, e^), where 

e (d) := — - (1 - |A 3 |) n , with A 3 the third largest eigenvalue of M by setting e = 0. (5) 

The proof of Proposition [Q is presented in Section IIII-DI which employs a fact from matrix pertur- 
bation theory (e.g., ETTl . ll22l ) relating the size of e to the distance between perturbed and unperturbed 
eigenvalues. Also, we will stress that this proof is based on that of Theorem [Q The above bound e^ d ' 
ensures average consensus for arbitrary strongly connected topologies. Due to the power n, however, the 
bound is rather conservative. This power is unavoidable for any perturbation bound result with respect 
to general matrices, as is well known in matrix perturbation literature ||2TI . ll22l . In Section [Vj we will 

2 A digraph Q with its adjacency matrix A = [atj] is balanced if X)?=i a ij = X/?=i a J« f° r a ^ *• Equivalently, the system 
matrix I — L of the standard consensus algorithm ((4) is both row and column stochastic (3|. |4l. 



exploit structures of some special topologies, which yield less conservative bounds on e. Also, we see 
that the bound in © involves A3, the second largest eigenvalue of either I — L or S (matrix M is block- 
diagonal when e = 0). This infers that, in order to bound e, we need to know the structure of the agent 
network. Such a requirement when bounding some parameters in consensus algorithms, unfortunately, 
seems to be not unusual 0, ||25l , 1126*1 . 



C. Proof of Theorem \J\ 

We present the proof of Theorem Q] First, we state a necessary and sufficient condition for average 
consensus in terms of the spectrum of the matrix M. 

Proposition 2. The deterministic algorithm © achieves average consensus if and only if 1 is a simple 
eigenvalue of M, and all other eigenvalues have moduli smaller than one. 

Proof. (Sufficiency) Since every column of M sums up to one, 1 is an eigenvalue of M and [1 T l T ] T 
is a corresponding left eigenvector. Note also that M[1 T 0] T = [1 T 0] T ; so [l T 0] T G M. 2n is a right 
eigenvector corresponding to the eigenvalue 1. Write M in Jordan canonical form as 



M = VJV" 1 



Hi 



V2n 



1 
J' 



"2n 



where in, z\ G C 2n , i G [l,2n], are respectively the (generalized) right and left eigenvectors of M; and 
ji g (£(2n-i)x(2n-i) con (; a i ns the Jordan block matrices corresponding to those eigenvalues with moduli 



smaller than one. For the eigenvalue 1 choose y\ 
Now the /cth power of M is 

r i 



[l 1 Of and z x = (1/nW IT; thus z xVi = 1 - 



T iT]T. 



M h 



v^V" 1 



V 



(J') 



l\k 



V 



T 

yxzx 



±1V ill 



as k 



00. 



Therefore 

x(k) 
s(k) 



M K 



x(0) 
S (0) 



ill T Ill T 











s(0) 
S (0) 











as k 



00. 



(Necessity) First we claim that the eigenvalue 1 of M is always simple. Suppose on the contrary that 
the algebraic multiplicity of 1 equals two. The corresponding geometric multiplicity, however, equals 
one; this is checked by verifying rank(Af — I) = 2n— 1. Thus there exists a generalized right eigenvector 
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u 



T „,T]T 



rut u 



y ^ T^2n suc fo t h at [m _ jy u — q^ an( j (m _ j^ u j s a r ight eigenvector with respect to the 





U\ 


= c 


1 




U2 








eigenvalue 1. Since [1 0] is also a right eigenvector corresponding to the eigenvalue 1, it must hold: 



(M - I)u = c[V 0] 1 , for some scalar c / 

-L el 

L S-I-el 



— Lu\ + eu2 = c\ 

Lu\ + (S — I)u2 — eu2 = 

=> {S-I)u 2 = c\. 

One may verify that rank (S — I) = n — 1 but rank([,S — / cl]) = n. Hence there is no solution for u 2 , 
which in turn implies that the generalized right eigenvector u cannot exist. This proves our claim. 

Now suppose that there is an eigenvalue A of M such that A / 1 and |A| > 1. But this immediately 
implies that lim^oo M k does not exist 01. Therefore, average consensus cannot be achieved. ■ 



Next, we introduce an important result from matrix perturbation theory (e.g., G01 Chapter 2]), which 
is found crucial in analyzing the spectral properties of the matrix M in ([3]). The proof of this result can 
be found in EOl Sections 2.8 and 2.10]. An eigenvalue of a matrix is said semi-simple if its algebraic 
multiplicity is equal to its geometric multiplicity. 

Lemma 1. Consider an n x n matrix W(e) which depends smoothly on a real parameter e > 0. Fix 
/ G [l,n]; let Ai = • • • = A; be a semi-simple eigenvalue of W(0), with (linearly independent) right 
eigenvectors y\ , . . . , y\ and (linearly independent) left eigenvectors z\ , . . . , z\ such that 



:r 



m 



in 



i. 



Consider a small e > 0, and denote by Aj(e) the eigenvalues of W(e) corresponding to Aj, i E [1,^]- 
Then the derivatives dAj(e)/de| e= o exist, and they are the eigenvalues of the following / x / matrix: 

z\Wy x ■ ■ ■ z[Wyi 

where W := dW(e)/de\ e=0 . (6) 



zJW Vl 



zfW yi 



Now we are ready to prove Theorem Q] The necessity argument follows from the one for ll23l 
Theorem 2]; indeed, the class of strongly connected digraphs characterizes the existence of a distributed 
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algorithm that can solve average consensus. For the sufficiency part, let 



M, 



o •= 



I-L 

L S 



and F 



/ 
-/ 



(7) 



Then M = Mq + eF, and we view M as being obtained by "perturbing" Mq via the term eF. Also, 
it is clear that M depends smoothly on e. Concretely, we will first show that the eigenvalues Aj of the 
unperturbed matrix Mq satisfy 

1 = A 1 = A 2 > |A 3 | >•••> |A 2 „|. (8) 

Then using Lemma Q] we will establish that after a small perturbation eF, the obtained matrix M has only 
a simple eigenvalue 1 and all other eigenvalues have moduli smaller than one. This is the characteristic 
part of our proof. Finally, it follows from Proposition |2] that average consensus is achieved. It should 
be pointed out that, unlike the standard consensus algorithm (01), the tools in nonnegative matrix theory 
cannot be used to analyze the spectrum of M directly due to the existence of negative entries. 

Proof of Theorem^ (Necessity) Suppose that Q is not strongly connected. Then at least one node of Q 
is not globally reachable. Let V* denote the set of non-globally reachable nodes, and write its cardinality 
card(Vp) = r, r G [1, n]. If r = n, i.e. Q does not have a globally reachable node, then Q has at least two 
distinct closed strong components 11271 Theorem 2.1]. In this case, if the nodes in different components 
have different initial states, then average consensus cannot be achieved. It is left to consider r < n. 
Let V g := V — V* denote the set of all globally reachable nodes; thus V g is the unique closed strong 
component in Q E71 Theorem 2.1]. Consider an initial condition (x(0), 0) such that all nodes in V g have 
the same state eel, and not all the states of the nodes in V* equal c. Hence x a / c. But no state 
or surplus update is possible for the nodes in V g because it is closed, and therefore average consensus 
cannot be achieved. 

(Sufficiency) First, we prove the assertion d8). Since Mq is block (lower) triangular, its spectrum is 
<j(Mo) = a(I— L)Ua(S). Recall that the matrices I—L and S are row and column stochastic, respectively; 
so their spectral radii satisfy p(I — L) = p(S) = 1. Now owing to that Q is strongly connected, I — L 
and S are both irreducible; thus by the Perron-Frobenius Theorem (see, e.g., ||28l Chapter 8]) p(I — L) 
(resp. p(S)) is a simple eigenvalue of I — L (resp. S). This implies ((8]). Moreover, for Ai = A 2 = 1, one 
derives that the corresponding geometric multiplicity equals two by verifying rank(Mo — I) = 2n — 2. 
Hence the eigenvalue 1 is semi-simple. 

Next, we will qualify the changes of the semi-simple eigenvalue Ai = A 2 = 1 of M$ under a small 
perturbation eF. We do this by computing the derivatives d\i(e)/de and riA 2 (e)/de using Lemma [Q here 
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Ai(e) and A2(e) are the eigenvalues of M corresponding respectively to Ai and A2. To that end, choose 
the right eigenvectors 7/1,7/2 and left eigenvectors zi,z% of the semi-simple eigenvalue 1 as follows: 



Y :-- 



Vx 2/2 






1 




T 
z l 




> 


1 T ~ 






, Z:= 


= 






"2 


-nv 2 




T 

4_ 




T 






Here v\ G K n is a left eigenvector of I— L with respect to p(I — L) such that it is positive and scaled to 
satisfy v[l = 1; and V2 G M n is a right eigenvector of S corresponding to p(S) such that it is positive 
and scaled to satisfy 1 t t;2 = 1. The fact that positive eigenvectors v\ and V2 exist follows again from the 
Perron-Frobenius Theorem. With this choice, one readily checks ZY = I. Now since dM/de\ e= o = F, 
the matrix © in the present case is 











T 

V{ V2 



-nviV2 



zfFyi z{Fy 2 

z^Fyi z 2 r Fy 2 

It follows from Lemma [Q that for small e > 0, the derivatives d\i(e)/de, d\2{e)/de exist and are the 
eigenvalues of the above matrix. Hence d\\{e)/de = 0, and d\2(e)/de = —nv'[v2 < 0. This implies that 
when e is small, Ai(e) stays put while A2(e) moves to the left along the real axis. Then by continuity, 
there must exist a positive 5\ such that \i{5\) = 1 and \2{5\) < 1. On the other hand, since eigenvalues 
are continuous functions of matrix entries (e.g., ||2T1 . Il22l ). there must exist a positive 82 such that 
I Ai (^2 ) I < 1 for all i G [3,2n]. Thus for any sufficiently small e G (0, min{<5i, 62}), the matrix M 
has a simple eigenvalue 1 and all other eigenvalues have moduli smaller than one. Therefore, from 
Proposition [2 the conclusion that average consensus is achieved follows. ■ 

Remark 1. Assuming that the deterministic algorithm © converges to the average, the speed of its 
convergence is governed by the second largest (in modulus) eigenvalue of the matrix M. We denote this 
particular eigenvalue by A 2 , and refer to it as the convergence factor of algorithm ©. Note that A 2 
depends not only on the graph topology but also on the parameter e, and A 2 < 1 is equivalent to average 
consensus (by Proposition [2]). 

Remark 2. Because of adding surpluses, the matrix M in © is double in size and is not nonnegative. 
Hence standard nonnegative matrix tools cannot be directly applied; this point was also discussed in lfT2l . 
In |[T9l a system matrix containing negative entries was analyzed, which depends however on symmetry 
of network structures. By contrast, we deal with general network topologies and have demonstrated that 
certain matrix perturbation tools are useful in proving convergence. 
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D. Proof of Proposition [7] 

Some preliminaries will be presented first, based on which Proposition [TJ follows immediately. Hence- 
forth in this subsection, the digraph Q is assumed to be strongly connected. We begin by introducing 
a metric for the distance between the spectrums of Mq and M; here M = Mq + eF, with Mq 
and F in ^J}. Let cr(Mo) := {Ai,...,A2 n } (where the numbering is the same as that in (HJ) and 
a(M) := {Ai(e), . . . , A2 n (e)}- The optimal matching distance d (<r(Mo), ct(M)) (2TJ, |[22l is defined by 

d(a(M ),a(M)) := min max |A< - A 7r(i) (e)|, (9) 

*" i6[l,2n] 

where 7r is taken over all permutations of {1, . . . ,2n}. Thus if we draw 2ra identical circles centered 
respectively at Ai, . . . , \2n, then d (tr(Mo), cr(M)) is the smallest radius such that these circles include 
all Ai(e), . . . , A2n(e)- Here is an upper bound on the optimal matching distance ETl Theorem VIII. 1.5]. 

Lemmal. d(a(M ),a(M)) < 4 (||Af ||oo + Halloo) 1 - 1 /" \\eF\\Ur. 

Next, we are concerned with the eigenvalues X^(e), . . . , A2 n (e) of M, whose corresponding unperturbed 
counterparts A3, ... , A2n of Mq lie strictly inside the unit circle (see the proof of Theorem [TJ). 

Lemma 3. If the parameter e G (0, e^) with l^ in ©, then |A 3 (e)|, . . . , |A 2 „(e)| < 1. 

Proof. Since L = D — A and S = (I — D) + B, one can compute ||£||oo = 2max ie [ 1 >n i d; < 2 and 
II^Hoo <n. Then HMqHoo < ||i||oo + Halloo < 2 + n and WFW^ < 1. By Lemma EJ 

(i(a(Mo),a(M)) <4 (2||M ||oo + e||F|| oo ) 1 - 1 /- (eHF^) 1 /" 

< 4 (4 + 2n + e) 1 " 1 /" e 1/n < 4 (4 + 2n + e) e 1/n < 1 - |A 3 |. 

The last inequality is due to e < e^ in (f5]). Now recall from the proof of Theorem [TJ that the 
unperturbed eigenvalues A3,...,A2n of Mq he strictly inside the unit circle; in particular, (|8) holds. 
Therefore, perturbing the eigenvalues A3,...,A2 n by an amount less than e, the resulting eigenvalues 
As(e), . . . , A2n(e) will remain inside the unit circle. ■ 

It is left to consider the eigenvalues Ai(e) and A2(e) of M. Since every column sum of M equals one 
for an arbitrary e, we obtain that 1 is always an eigenvalue of M. Hence Ai(e) must be equal to 1 for 
any e. On the other hand, for A2(e) the following is true. 

Lemma 4. If the parameter e G (0,e^) with e^ in ©, then |A 2 (e)| < 1. 

Proof. First recall from the proof of Theorem [TJ that A2 = 1 and d\2(e)/de < 0; so for sufficiently small 
e > 0, it holds that |A 2 (e)| < 1. Now suppose that there exists 5 G (0, e^) such that \X 2 (S)\ > 1. Owing 
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to the continuity of eigenvalues, it suffices to consider | A2 («5) I = 1- There are three such possibilities, for 
each of which we derive a contradiction. 

Case 1: A2OJ) is a complex number with nonzero imaginary part and | A2 (<5) I = 1. Since M is a real 
matrix, there must exist another eigenvalue Aj(<5), for some i G [3,2n], such that Xi(5) is a complex 
conjugate of A2(<5). Then |Ai(<5)| = | A2 (<5) I = L which is in contradiction to that all the eigenvalues 
Aa(<5), . . . , A2n(^) stay inside the unit circle as 5 G (0, e^) by Lemma [3] 

Case 2: \ 2 (S) = -1. This implies at least d (a(M ), cr{M)) = 2, which contradicts d (a(M ), cr(M)) < 
1 — I A3 1 < 1 when © holds. 

Case 3: A2OJ) = 1. This case is impossible because the eigenvalue 1 of M is always simple, as we 
have justified in the necessity proof of Proposition [2] ■ 

Summarizing Lemmas [3] and [4] we obtain that if the parameter e G (0, e d )) with e^ d ' in Q, then 
Ai(e) = 1 and | A2 (e) | , | A3 (e) | , . . ., |A2 n (e)| < 1. Therefore, by Proposition |2] the deterministic algorithm 
((3]) achieves average consensus; this establishes Proposition [TJ 

IV. Averaging in Asynchronous Networks 

We move on to solve Problem 2. First, a surplus-based gossip algorithm is designed for digraphs, 
which extends those algorithms (6]-||9] only for undirected graphs. Then, mean-square and almost sure 
convergence to average consensus is justified for arbitrary strongly connected topologies. 

A. Algorithm Description 

Consider again a network of n agents modeled by a digraph Q = (V,£). Suppose that at each time, 
exactly one edge in £ is activated at random, independently from all earlier instants. Say edge (j, i) is 
activated at time k G Z+, with a constant probability pij G (0, 1). Along the edge, the state information 
Xj(k) and surplus Sj(k) are transmitted from node j to i. The induced update is described as follows: 
(i) Let u>ij G (0, 1) be the updating weight, and e > be a parameter. For node i: 

Xi(k + 1) = Xi(k) + Wij(xj(k) - Xi(k)) + ewijSi(k), (10) 

Sl (k + 1) = Si (k) + Sj (k) - { Xi (k + 1) - Xi(k)), (11) 

(ii) For node j: Xj(k + 1) = Xj(k) and Sj(k + 1) = 0. 

(iii) For other nodes I G V — {i, j}: Xi(k + 1) = x\{k) and si(k + 1) = si(k). 

We discuss potential applications of this protocol in sensor networks. Our focus is again on the situations 
of directed information flow, like asynchronous communication with variable ranges or unidirectional 
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geographic routing |[T3l . |[T4l . First, the states and surpluses can be implemented as ordinary variables in 
sensors, since their exchange and updating rules are fairly simple and purely local. Also, we will see that 
the parameter e, as in the algorithm ©, affects the convergence of the algorithm, and must be chosen 
to be sufficiently small. A valid upper bound for e involves again non-local information of the network; 
thus computing a bound offline and then notifying that value to every node is one possible way to deal 
with this restriction. 

Now let Aji be the adjacency matrix of the digraph Qji = (V,{(j, i)}) given by Aji = WijfifJ, 
where /j, fj are unit vectors of the standard basis of W n . Then the Laplacian matrix Lji is given by 
Lji := Dji — Aji, where Dji = Wijfiff . Thus Lji has zero row sums, and the matrix / — Lji is row 
stochastic. Also define Sji := I — (fj — fi)fj; it is clear that Sji is column stochastic. With these 
matrices, the iteration of states and surpluses when edge (j, i) is activated at time k can be written in 
the matrix form as 



x(k + 1) 
s(k + l) 



M(k) 



x(k) 
s(k) 



, where M(k) = Mji :- 



I -L 



j i 



eD 



L 



j i 



S 



j i 



eD 



j i 



(12) 



We have several remarks regarding this algorithm, (i) The matrix M(k) has negative entries due to 
the presence of the Laplacian matrix Lji in the (2, l)-block. (ii) The column sums of M(k) are equal 
to one, which implies that the quantity x(k) + s(k) is constant for all k. (iii) By the assumption on 
the probability distribution of activating edges, the sequence M(k), k = 0, 1,..., is independent and 
identically distributed (i.i.d.). Henceforth we refer to ([T2l as the gossip algorithm, and establish its mean- 
square and almost sure convergence in the sequel. 

Example 2. Consider again the network of four nodes in Fig. Q] We give one instance of the matrix 
M(k) when edges (3, 2) is activated, with the updating weight W23 = 1/2. 



M 



32 



1 























1/2 


1/2 








e/2 











1 























1 























1 











1/2 


-1/2 








l-e/2 


1 









































1 



We see that M(k) has negative entries, and every column sums up to one. 
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B. Convergence Result 

We present our main result in this section. 

Theorem 2. Using the gossip algorithm ([T2T i with the parameter e > sufficiently small, the agents 
achieve mean-square average consensus if and only if the digraph Q is strongly connected. 

We remark that Theorem |2]generalizes the convergence result in |6l from undirected to directed graphs. 
The problem of achieving average consensus on gossip digraphs is, however, more difficult in that the 
state sum of the nodes need not be invariant at each iteration. The key in our extension is to augment 
surplus variables which keep track of individual state updates, thereby ensuring average consensus for 
general strongly connected digraphs. This approach was previously exploited in |[T2l for a broadcast gossip 
algorithm, however without a convergence proof. We remark that our technique to prove Theorem |2] based 
on matrix perturbation theory, can be applied to ITT21 and justify the algorithm convergence. 

We note that in the literature, many works for agents with non-scalar dynamics deal only with static 
networks (e.g., ll25l . ||29l ). Some exceptions include |[T9l which relies heavily on graph symmetry and 
which is based on dwell-time switching. By contrast, we study general digraphs that switch at every 
discrete time and each resulting update matrix is not nonnegative. The corresponding analysis is difficult, 
and we will demonstrate again that matrix perturbation tools are instrumental in proving convergence. 

To prove Theorem |2] three preliminary results are to be established in order. The first is a necessary 
and sufficient condition for mean-square average consensus characterized by the spectrum of the matrix 
E [M(k) <g> M(k)], where <£> stands for the Kronecker product. This condition will be used in the 
sufficiency proof of Theorem |2] Since the matrices M(k) are i.i.d. we denote E [M(k) ® M(k)] by 
E [M <g> M]. This result corresponds to Proposition |2] for the deterministic algorithm in Section HIT] 

Proposition 3. The gossip algorithm (TT2T i achieves mean-square average consensus if and only if 1 is a 
simple eigenvalue of E [M (g> M] , and all the other eigenvalues have moduli smaller than one. 

Proof. (Sufficiency) Define the consensus error e(k), k > 0, as 

x(k) 
s(k) 



e(k) :-- 



XaX 







2n . (13) 



We must show that E [e(k) T e(k)] — > as k — > oo. Since l T (x(k) + s(k)) = l T x(0) for every k > 0, 
e(k) is orthogonal to [1 T 1 T ] T (i.e., [1 T l T ]e(k) = 0). Also it is easy to check e(k + 1) = M(k)e(k); 
thus e(k + l)e(k + 1) T = M(k)e(k)e(k) T M(k) T . Collect the entries of e(k)e(k) T , drawn column wise, 
into a vector e(k) £ M 4n . It then suffices to show that E[e(k)] — > as k — >oo. 
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Now it follows that e(fc+l) = (M(k) ® Af(Jfe)) e(fc) (cf. 0). Hence J5 [e(/c + l)|e(fc)] =£[M® M] e(k), 
and condition repeatedly to obtain E [e(k)] = E [M ® M] k e(0). Note that every column of E [M <g> M] 
sums up to one, and 

E [M (g) M] 



1 







1 




)■ 


1 




® 


1 





so 1 is an eigenvalue of E 1 [M <g> M], with [1 J 1 J ] T ® [V V ] T and [V 0] T <g> [1 J 0] r as associated left 
and right eigenvectors, respectively. Write E [M (g> M] in Jordan canonical form as 



E[M®M] = VJV 



-l 



Hi 



Vir, 



1 
J' 



T 

Z An 2 



T 



as k 



oo. 



where J' contains the Jordan block matrices corresponding to those eigenvalues with moduli smaller 
than one. For the eigenvalue 1 choose m = [1 T 0] T (g> [1 T 0] T and z\ = l/n 2 [l T l T ] T <g> [1 T 1 T ] T ; thus 
z ^ yi = l. Then the kth power of E [M ® M] is 

t i. 1 10 

E[M(g)M] fe = yj fc y- 1 = v v~ 

(J') fc 
Therefore we obtain 

2n / 2n \ 2n 

£ [g(fc)] -> yi^fe(O) =yiJ2\ e *(°) E e i(°) = ^ E e *(°) • ° = °> 

i=l \ j=l J i=l 

where the second equality is due to e(k) _L [1 T 1 T ] T . 

(Necessity) Suppose E [e(k) T e(k)] — > as k — > oo. Then E [ei(k) 2 ] — > for all i. It thus follows 
from the Cauchy-Schwartz inequality (e.g., HH) that E [|e i (/c)e j (A;)|] 2 < E [ei{k) 2 ] E [ej(k) 2 ] -> 0, for 
every i,j e [1, 2n]. This implies £ [e(k)] -> 0; so lim^oo £ [M M] fe e(0) = 0. Also, it is known El 
that linifc^oo E [M <g> M] exists if and only if there is a nonsingular V such that 



E[M®M] = VJV~ 



Vi 



Uin 2 



In 
J' 



JT 



T 

Z An 2 



where k E [l,2n] and p(J') < 1. Hence lim^^ £ [M ® M] fc e(0) = (Ef=i 2^ T ) g (°) = °- Now 
suppose k > 1. Choose as before zx = l/ra 2 [l T l T ] T (g> [1 T 1 T ] T , and recall zfe(0) = 0. We know from 
the structure of J that for every j £ [2, re], z, is linearly independent of zi, which indicates zje(0) ^ 
and consequently (J^iLi y« z D ^(0) 7^ 0- Therefore k = 1, i.e., the eigenvalue 1 of E [M (g> M] is simple 
and all the others have moduli smaller than one. ■ 
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The second preliminary is an easy corollary of the Perron-Frobenius Theorem. 

Lemma 5. (cf. ll30l Chapter XIII]) Let W be a nonnegative and irreducible matrix, and A be an eigenvalue 
of W. If there is a positive vector v such that Wv = Xv, then A = p(W). 

Proof. Since W is nonnegative and irreducible, the Perron-Frobenius Theorem implies that p(W) is a 
simple eigenvalue of W and there is a positive left eigenvector w corresponding to p(W), i.e., w T W = 
w T p{W). Then 

p(W){v T w) = v T {p{W)w) = v T (W T w) = {Wv) T w = (\v) T w = \(v T w), 

which yields (A — p(W))(v T w) = 0. Since both v and w are positive, we conclude that A = p(W). ■ 

The last preliminary is on the spectral properties of the following four matrices: E [(I — L) <g> (I — L)\, 
E [{I -L)® S], E[S®(I- L)], and E[S® S]. 

Lemma 6. Suppose that the digraph Q = (V,£) is strongly connected. Then each of the four matrices 
E [(I -L)®(I-L)],E [{I -L)®S],E[S®{I-L)], and E [S (g) 5] has a simple eigenvalue 1 and 
all other eigenvalues with moduli smaller than one. 

Proof. First observe that all the four matrices are nonnegative, for I — Lji and Sji are for every (j, i) G £. 
Then since (/ — Lji)l = 1 and l T Sji = 1 T for every (j, i) G £, a short calculation yields the following: 

E [(I - L) ® (I - L)] (1 ® 1) = (1 ® 1); ,B [(/ - L) ® 5] (1 ® v 2 ) = (1 ® f 2 ); 
(1 T ® uf )£ [5 <8> (/ - L)] = (1 T ® uf ); (1 T ® l 7 )^ [5 ® S] = (1 T ® 1 T ). 

Here v\ is positive such that v\E [I — L] = vf and vfl = 1, and d 2 is positive such that E [S] V2 = V2 
and \ T V2 = 1. Thus each matrix has an eigenvalue 1, and the corresponding right or left eigenvector is 
positive. In what follows, it will be shown that all the four matrices are irreducible. Then the conclusion 
will follow from Lemma [5] and the Perron-Frobenius Theorem. 

We first prove that E [{I — L) (g> (J — L)] is irreducible, which is equivalent to that the digraph Q = 
(V,£) corresponding to this matrix is strongly connected, where V := V x V = {(i,i') : i,i' G V}. 
Arrange the nodes in V so that V = Vi U • • • U V n , where V p = {(p,l), . . . , (p, n)} for every p G [1, n]. 
Now since E [(I — L) (g> (I — L)] = £\ • ^ e£ Pij{I — Lji) (8) (I — Ljj), the digraph ^ is the union of the 
digraphs corresponding to Pij(I — Lji) (I — Lji). Note that each pij{L — Lji) (8) (I — Lji) gives rise 
to (i) an edge from (p,j) to (p,i) in V p for every p G [l,n], and (ii) edges from some nodes in Vj to 
some nodes in Vj. Owing to that Q is strongly connected, the union of the above edges yields, for every 
i,j G [1, n], (i) a directed path from (p, i) to (p, j) in V p for every p G [1, n], and (ii) directed paths from 
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some nodes in Vj to some nodes in V,. This implies that there is a directed path from (p, i) to (q,j) for 
every p,q,i,j G [l,n], i.e., ^ is strongly connected, and hence E [{I — L) <g> (I — L)] is irreducible. 

By a similar argument, we derive that the digraphs corresponding to E [{I — L) <g> S], E[S ® (I — L)\, 
and E [S <8) S] are all strongly connected. Therefore they are also irreducible. ■ 

We are now ready to provide the proof of Theorem |2] The necessity argument is the same as Theorem Q] 
Below is the sufficiency part. 

Proof of Theorem \2\ (Sufficiency) By Proposition [3] it suffices to show that the matrix E [M <g> M] 
has a simple eigenvalue 1, and all other eigenvalues with moduli smaller than one. Let Mo(k) := 



I-L(k) 

L{k) S{k) 



and F(k) :-- 



D(k) 
-D(k) 



; from (O we have M(k) = M (k) + eF(k). Then write 



E [M <g> M] = E [(M + eF) (M + eF)] = E[M ® M ] + eE [M <g> F + F <g> M + F eF] 



F< 



I- L 
L 

D 
-L> 



I-L 

L 5 



I-L 

L 5 



+ 



> + eF<^ 

D 
-D 



I-L 

D 
-L> 



D 
-L> 



+ 



Let p G [1, 4n], and pn := {(p — l)n + 1, . . . ,pn}. Consider the following permutation: 

{n, 3n, . . . , (2n — l)n; 2n, 4n, . . . , 2nn; 
(2n + l)n, (2n + 3)n, . . . , (An - l)n; (2n + 2)n, (2n + 4)n, . . . , Ann}. 
Denoting by P the corresponding permutation matrix (which is orthogonal), one derives that 

P T E [M ®M]P = P T E [M ® M ] P + eP T E [M <g> F + F <g> M + F <g> eF] P =: M + eF, (14) 

where 

f (I - L) ® (I - L) 



Mo :=F 



F := E 



(I-L)®L 
L®(I-L) 

L®L 

(I-L)(g)D 

-(I-L)(g)D 

L®£> 

-L®D 





(I-L)®S 

S®(I-L) 



D®(I-L) 

D®L 
-D®(I-L) 



S®L S®S 

D®eD 

D®(S-eD) 
(S -eD)®D 



-D®L D®(eD-S)-S®D 
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Based on the above similarity transformation, we henceforth analyze the spectral properties of the 
matrix Mq + eF. For this, we resort again to a perturbation argument, which proceeds similarly to the 
one for Theorem Q] First, since the digraph Q is strongly connected, it follows from Lemma [6] that the 
eigenvalues of the matrix Mq satisfy 



1 = Ai = Xi 



A, 



\a > IAkI > ••• > |A 



An 2 • 



(15) 



For the eigenvalue 1, one derives that the corresponding geometric multiplicity equals four by verifying 
rank(Mo — I) = An 2 — 4. Thus 1 is a semi-simple eigenvalue. 

Next, we will qualify the changes of the semi-simple eigenvalue Ai = A2 = A3 = A4 = 1 of Mq under 
a small perturbation eF. We do this by computing the derivatives d\i(e)/de, i G [1,4], using Lemma [TJ 
here Aj(e) are the eigenvalues of Mq + eF corresponding to Aj. To that end, choose the right and left 
eigenvectors of the semi-simple eigenvalue 1 as follows: 



Y :-- 



V\ V2 V3 V4 



n 









nv2 <8> nv2 







nv2 <S> 1 

-11V2 <8> nv2 




1 <K> nv2 





1®1 

-1 (g> nv2 
-nv2 ® 1 



-nv2 <8> nv2 nv2 <S> nv2 



Z :-- 



T 

4 




T 

4 




T 
z 3 




T 





n n 



n n 



1\T l t T 

n n 



n 



H T ®vf 







in in 

vj <g> vj 














Here v\ is positive such that vf E [I — L] = vf and vf 1 = 1, and V2 is positive such that E [S] V2 = i>2 
and 1 «2 = 1. With this choice, it is readily checked that ZY = I. Now the matrix Mq + eF depends 
smoothly on e, and the derivative d(Mo + eF)/de\ e= Q is 



Fq:~- 



d(M + eF) 



de 



e=0 



+ 


4) 

de J 


e=0 









(I-L)®D 


D®{I-L) 








-(I-L)®D 


D®L 


D®S 





L®D 


-D®(I-L) 


S®D 





-L 


®D 


-D®L 


-D&S-S&D 
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Hence the matrix © in the present case is 

zjF oyi zfF y 2 zfF y 3 z\hvl 
z$Foyi z 2 F y 2 2$F y s z^F y 4 



zjF oyi ziF y 2 z%F y 3 zjF y, 
zjF oyi zjF y 2 zjF y 3 zjF y 4 












nvjE[D]v 2 


-nvjE[D]v 2 





nvjE[D]v 2 





-nvfE[D]v 2 





nv{E[D]v 2 


nvjE[D]v 2 







2nvjE[D]v 2 

It follows from Lemma [Q that for small e > 0, the derivatives d\i(e)/de, i G [1,4], exist and are the 
eigenvalues of the above matrix. Hence d\i(e)/de = 0, d\ 2 (e)/de = dX 3 (e)/de = —nvj E[D\v 2 < 0, 
and d\±(e)/de = —2nv\E\D\v 2 < 0. This implies that when e is small, Ai(e) stays put, while A2(e), 
Aa(e), and A^e) move to the left along the real axis. So by continuity, there exists a positive 5\ such 
that Ai(<5i) = 1 and A2(^i), A3(<5i), A4(<5i) < 1. On the other hand, by the eigenvalue continuity there 
exists a positive 5 2 such that | A« (^2) I < 1 for all i G [5,4n 2 ]. Therefore for any sufficiently small 
e G (0,m.in{5i,5 2 }), the matrix Mo + tF h as a simple eigenvalue 1 and all other eigenvalues with 
moduli smaller than one. ■ 

Remark 3. Assuming that the gossip algorithm (fT2l ) converges to the average in mean square, the speed 
of its convergence is determined by the second largest (in modulus) eigenvalue of the matrix E [M M]. 
We denote this particular eigenvalue by A;f , and refer to it as the convergence factor of algorithm (fT2l ). 
Notice that X 2 9 depends not only on the graph topology but also on the parameter e, and A 2 < 1 is 
equivalent to mean-square average consensus (by Proposition [3). 

Remark 4. We have established that for small enough e, the gossip algorithm (fT2l i achieves mean-square 
average consensus. Using the same notion of optimal matching distance and following the procedures 
as in Subsection Mi-Pi it may be possible to derive a general bound for e by solving the inequality 
4 (||M ||oo + ||M + eF|| 00 ) 1 - 1 / n ||eF||^ n < 1 - |A 5 |, where M ,F are from CH) and A 5 from (£5). 
The corresponding computation is however rather long, since the involved matrices are of much larger 
sizes. Such a general bound unavoidably again involves n, the number of agents in the network, and A5, 
the second largest eigenvalue of one of the four matrices in Lemma [6l Consequently, the bound for e is 
conservative and requires the structure of the network. 

Finally, we consider almost sure average consensus. Note that the gossip algorithm (fT2l ) can be viewed 
as a jump linear system, with i.i.d. system matrices M(k), k G Z+. For such systems, it is known 
(e.g., |[3~n Corollary 3.46]) that almost sure convergence can be implied from mean-square convergence. 
Therefore the result on almost sure convergence is immediate. 
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Corollary 1. Using the gossip algorithm (fT2l with the parameter e > sufficiently small, the agents 
achieve almost sure average consensus if and only if the digraph Q is strongly connected. 



V. Special Topologies 

We turn now to a special class of topologies - strongly connected and balanced digraphs - and 
investigate the required upper bound on the parameter e for the deterministic algorithm d3). Furthermore, 
when these digraphs are restricted to symmetric or cyclic respectively, we derive less conservative e 
bounds compared to the general one in d5). 

Given a digraph Q = (V,£), its degree d is defined by d := maxj £ ycard(A/' i + ). In the deterministic 
algorithm © choose the updating and sending weights to be respectively a^ = l/(2dn) and bij = l/{dn), 
for every (j, i) £ £. This choice renders the two matrices I — 2L and S identical, when the digraph Q is 
balanced. We will see that the equality I — 2L = S supports a similarity transformation in dealing with 
the cyclic case below. 

Lemma 7. Suppose that the parameter e satisfies e G (0,2), and the zeros of the following polynomial 
for every fi ^ with \fi — l/(2n)| < l/(2n) lie strictly inside the unit circle: 

p(X) := X 2 + a 1 X + a , (16) 

where a® := 2/j, 2 — 3/j, — e + 1, a\ := 3/i + e — 2. Then the deterministic algorithm © achieves average 
consensus on strongly connected and balanced digraphs. 

Proof. We analyze the spectral properties of the matrix M in terms of those of the Laplacian matrix L. 
Let fa, i = 1, . . . ,n, be the ith eigenvalue of L. Since Q is balanced and all the updating weights are 
aij = l/(2dn), it follows from the Gershgorin Theorem ll28l Chapter 6] that |/ij — l/(2n)| < l/(2n). 
Further, as Q is strongly connected, by the Perron-Frobenius Theorem [28. Chapter 8] we get that ^1 = 
is simple. Now substituting the equality S = I — 2L into © one obtains 

I -L el 

L I-2L-eI 
Consider the characteristic polynomial of M: 

(A-l)/ + L -el 

-L (X-l + e)I + 2L 

det (((A - 1)/ + L)((X - 1 + e)I + 2L) - eL) 

det ((A - 1)(A - 1 + e)I + 3(A - 1)L + 2L 2 ) . 



M 



det(AI - M) = det 
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Here the second equality is due to that (A — 1)/ + L and — L commute 11321 . By spectral mapping one 
derives that the 2n eigenvalues of M can be obtained by solving the following n equations: 

(A - 1)(A - 1 + e) + 3(A - I) m + 2tf 



0, t = l, 



,n. 



(17) 



For /ii = we have from dTTJ that Ai = 1 and A 2 = 1 - e. Since e G (0,2), A 2 G (-1, 1). Now fix 
i G [2, n] so that /ij ^ and | /x^ — l/(2n)| < l/(2ra). Note that the left hand side of (fTTT ) can be arranged 
into the polynomial p(X) in (fT6l ). whose zeros are inside the unit circle. It follows that 1 is a simple 
eigenvalue of M, and all other eigenvalues have moduli smaller than one. Therefore, by Proposition |2] 
we conclude that average consensus is achieved. ■ 

Now we investigate the values of e that ensure the zeros of the polynomial p(X) in (fT6l ) inside the 
unit circle, which in turn guarantee average consensus on strongly connected and balanced digraphs by 
Lemma [7] For this, we view the polynomial p(X) as interval polynomials [33] by letting fi take any value 
in the square: < Re(/i) < l/n, — l/(2n) < lm(fi) < l/(2n). Applying the bilinear transformation 
we obtain a new family of interval polynomials: 



p( 7 ) : = ( 7 - lf p 



7+1 
7-1 



1 + a + ai)7 2 + (2 - 2a )7 + (1 + a - a\) 



(18) 



Then by Kharitonov's result for the complex-coefficient case, the stability of ^(7) (its zeros have negative 
real parts) is equivalent to the stability of eight extreme polynomials ||33l Section 6.9], which in turn 
suffices to guarantee that the zeros of p{\) lie strictly inside the unit circle. Checking the stability of 
eight extreme polynomials results in upper bounds on e in terms of n. This is displayed in Fig. [2] as 
the solid curve. We see that the bounds grow linearly, which is in contrast with the general bound e 
in Proposition Q] that decays exponentially and is known to be conservative. This is due to that, from 
the robust control viewpoint, the uncertainty of p in the polynomial coefficients becomes smaller as n 
increases. 

Alternatively, we employ the Jury stability test ||34l to derive that the zeros of the polynomial p{\) 
are strictly inside the unit circle if and only if 



&:= 



1 a 
a 1 



> 0, ft := 



1 a 

a 1 

1 ai 

ao ol\ 



1 a.\ 

1 a 
a 1 



>0. 



(19) 



Here /3o and /3i turn out to be polynomials in e of second and fourth order, respectively; the corresponding 
coefficients are functions of \x and n. Thus selecting \i such that fi / and \/j, — l/(2n)| < l/(2n), we 
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Fig. 2. Upper bounds on parameter e such that deterministic algorithm ((3} achieves average consensus on general strongly 
connected balanced digraphs (solid and dashed curves) and cyclic digraphs (dotted curve). 



can solve the inequalities in ( fl~9l ) for e in terms of n. Thereby we obtain the dashed curve in Fig. [2] each 
plotted point being the minimum value of e over 1000 random samples such that the inequalities in (fT9l ) 
hold. This simulation confirms that the true bound on e for the zeros of p(X) to be inside the unit circle 
is between the solid and dashed curves. Since the discrepancy of these two curves is relatively small, it 
is suggested that our previous analysis based on Kharitonov's result may not very conservative. 

Here ends our discussion on e bounds for arbitrary balanced (and strongly connected) digraphs. In the 
sequel, we will further specialize the balanced digraph Q to be symmetric or cyclic, respectively, and 
provide analytic e bounds less conservative than d5j for the general case. In particular, the exponent n is 
not involved. 



A. Connected Undirected Graphs 

A digraph Q = (V,£) is symmetric if (j,i) G £ implies (i,j) £ £■ That is, Q is undirected. 

Proposition 4. Consider a general connected undirected graph Q. Then the deterministic algorithm © 
achieves average consensus if the parameter e satisfies e G (0, (1 — (l/n))(2 — (1/n)). 

Proof. The symmetry of the undirected graph Q results in the symmetry of its Laplacian matrix L. So all 
the eigenvalues p^ of L are real, and satisfy [i\ = and (\/i G [2,n]) /ij G (0, 1/n] (Q is connected). For 
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Hi = we know from dTTJl that Ai = 1, and A 2 G (-1, 1) since < e < (1 - (l/n))(2 - (1/n)) < 2. 
For in G (0, 1/n], i G [2,n], consider again the polynomial p(A) in (fT6l ). According to the Jury stability 
test for real-coefficient case 11551 , the zeros of p(X) are strictly inside the unit circle if and only if 

1 + Qo + ax > 0, 1 + ao — ax > 0, |qo| < 1. 

Straightforward calculations show that these conditions hold provided e G (0, (1 — (1/n)) (2 — (1/n)). 
Hence, the matrix M has a simple eigenvalue Ai = 1 and all others A2, • • • , \2n G (0, 1). Therefore, by 
Proposition [2] the deterministic algorithm © achieves average consensus. ■ 

It is noted that for connected undirected graphs, the upper bound on e ensuring average consensus 
grows as n increases. This characteristic is in agreement with that of the bounds for the more general 
class of balanced digraphs as we observed in Fig. [2] 

B. Cyclic Digraphs 

A digraph Q = (V,S) is cyclic if V = {1, ..., n} and S = {(1,2), (2,3), . . . , (n - l,n), (n, 1)}. So a 
cyclic digraph is strongly connected. 

Proposition 5. Suppose that the digraph Q is cyclic. Then the deterministic algorithm © achieves average 
consensus if the parameter e satisfies 

eG (O, (1- |A 3 |) ) , with A3 as in ®. (20) 

\ 3 + V5 / 

Further, in this case |A 3 | = yj\ - (1/n) + (l/(2n 2 )) + (l/n)(l - l/(2n)) cos 2vr/n. 

Before providing the proof, we state a perturbation result, the Bauer-Fike Theorem, for diagonalizable 
matrices (e.g., ll28l Section 6.3]). Recall that the matrix M in Q can be written as M = Mq + eF, with 
Mq and F in ©. Throughout this subsection, write A^(e) for the eigenvalues of M, and Aj for those of 
M . 

Lemma 8. Suppose that Mq is diagonalizable; i.e., there exist a nonsingular matrix V G C 2nx2n and a 
diagonal matrix J = diag(Ai, . . . , A27J such that Mq = VJV" 1 . If A(e) is an eigenvalue of M, then 
there is an eigenvalue Aj of Mq, for some i G [l,2n], such that |A(e) — Aj| < ||V||2 ||^ _1 ||2 H^lb- 

In other words, every eigenvalue of the perturbed matrix M lies in a circle centered at some eigenvalue 
of the unperturbed matrix Mq of the radius (||V||2 ||^ _1 ||2 H^lb)- We now present the proof of 
Proposition [5] 

Proof of Proposition^ Since the digraph Q is cyclic, we derive that its Laplacian matrix L is given by L = 
circ(l/(2n), 0, . . . , 0, -l/(2n)) - a circulant matrix 1361 with the first row [l/(2n) • • • - l/(2n)] G 
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M lxn . Let uj := e 2 ™/ 71 with i := y/^l. Then the eigenvalues \a of L are m = (l/(2n))(l - uj^ 1 ), 
i = l,...,n. Rewrite the equation (Q/7]) as (A(e) - l)(A(e) - 1 + e) + 3(A(e) - l)/ij + 2/i 2 = 0. Then for 
fii = 0, we have Ai(e) = 1 and A2(e) = 1 — e, corresponding respectively to the eigenvalues Ai, A2 of 
Mq. Evidently the upper bound in (1201 is strictly smaller than 2; so A2(e) G (—1, 1). 

We turn next to investigating the rest of the eigenvalues As(e), . . . , A2 n (e), for which we employ 
Lemma [8] Let 9 denote the n x n Fourier matrix given by 

1 
,n-l 



9 



1 


1 


1 


CO 


1 


LO 2 



UJ 



u 



1 w^ 1 LU 2 ^- 1 ) 



Co' 



(n-l)(n-l) 



Note that 9 is unitary, i.e., f2 x = 17* (the conjugate transpose of 91). It is a fact that_every circulant 

n 



matrix can be (unitarily) diagonalized by 91 ll36l Theorem 3.2.1]. Now let V :- 



91 91 



, and consider 



V- X M Q V 



9* 
-91* 91* 



I-L 
L S 



91 




9l*(I-L)9 
Q*5Q 



The last equality is due to S = I — 2L. Hence Mq is diagonalizable via V, and its spectrum is 

a(M ) = a(I - L) U a(S) = [l - i-(l - w 4 " 1 ), 1 - i(l - w*" 1 ) : i = 1, . . . , n\ . 



Also, by a direct calculation we get 



\v- 



(3 + V5)/2 and ||F|| 2 = >/2. It then follows 



from Lemma [8] that for every eigenvalue Xi(e) of M there is an eigenvalue Xi> of Mq, 1,1' S [3, 2n], 



such that |A/(e) — A/-| < 



IIV"" 1 !^ ||e-F|| 2 = ((3 + \/5)/2) >/2 e. So the upper bound of e in 
(|2Qb guarantees |A/(e) — Aj/| < 1 — | A3 1 ; namely, the perturbed eigenvalues still lie within the unit 
circle. Summarizing the above we have Ai(e) = 1 and | A2 (e) | , | A3 (e) | , . . . , |A2n(e)| < 1; therefore, the 
deterministic algorithm (f3) achieves average consensus by Proposition [2] Further, one computes that 



I A, 



max < 

ie[2,n] { 


2ra 


1 
1 

2n 


1 

H u) 

2n 



(1-w- 1 ) 



1 



1 



n 



(l-uT*) 



n 2n? n 



1 \ 2vr 
— cos — . 
2n I n 



Finally, in Fig. [2] we plot the upper bound on e in (1201 ) for the class of cyclic digraphs. We see that 
this bound decays as the number n of nodes increases, which contrasts with the bound characteristic 
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Qa Qb 

Fig. 3. Three examples of strongly connected but non-balanced digraphs. 



TABLE I 



J d ) Avn \(s) 



Convergence factors \ 2 ' and X 2 9 ' with respect to different values of parameter e. 





e — 


0.2 


e = 


0.7 


e = 


2.15 




A 2 


A 2 


A< d) 


x (s) 

A 2 


A 2 


^ 


Qa 


0.9963 


0.9963 


0.9993 


1.0003 


1.0003 


1.0020 


Q b 


0.9951 


0.9951 


0.9969 


0.9969 


0.9985 


1.0000 


Qc 


0.9883 


0.9883 


0.9930 


0.9930 


0.9966 


0.9993 



of the more general class of balanced digraphs. This may indicate the conservativeness of our current 
approach based on perturbation theory. Nevertheless, since the perturbation result used here is specific 
only to diagonalizable matrices, the derived upper bound in (l20l ) is less conservative than the general one 
in ©. 



VI. Numerical Examples 
A. Convergence Paths 

Consider the three digraphs displayed in Fig. [3] with 10 nodes and respectively 17, 29, and 38 edges. 
Note that all the digraphs are strongly connected, and in the case of uniform weights they are non-balanced 
(indeed, no single node is balanced). We apply both the deterministic algorithm ©, with uniform weights 
a = l/(2card(£ )) and b = l/card(£), and the gossip algorithm (fT2l . with uniform weight w = 1/2 and 
probability p = l/card(£). 

The convergence factors A!, and Af, (see Remarks Q] and [3) for three different values of the parameter 
e are summarized in Table U We see that small e ensures convergence of both algorithms (the gossip 
algorithm (fT2l requires smaller values of e for mean-square convergence), whereas large e can lead to 
instability. Moreover, in those converging cases the factors A;> and A;, decrease as the number of edges 
increases from Q a to Q c , which indicates faster convergence when there are more communication channels 
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Fig. 4. Convergence paths of states and surpluses: Obtained by applying the deterministic algorithm ((3} with parameter e = 0.7 
on digraph Q a . 
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Fig. 5. Sample paths of states: Obtained by applying the gossip algorithm (fj} with parameter e = 0.7 on digraphs Q a , Gb, and 

Go. 



available for information exchange. We also see that the algorithms are more robust on digraphs with 
more edges, in the sense that a larger range of values of e is allowed. 

For a random initial state x(0) with the average x a = and the initial surplus s(0) = 0, we display 
in Fig. [4] the trajectories of both states and surpluses when the deterministic algorithm © is applied on 
digraph Q a with parameter e = 0.7. Observe that asymptotically, state averaging is achieved and surplus 
vanishes. Under the same conditions, the gossip algorithm (PT2l ). however, fails to converge, as shown 
in Fig. [5J Applying algorithm (fT2l ) instead on the digraphs Q^ and Q c which have more edges, average 
consensus is again reached, and faster convergence occurs in Q c (see Fig. [5J. 
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Fig. 6. Convergence factor \, 2 of the deterministic algorithm ((3} with respect to parameter e. 
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Fig. 7. Convergence factor Aj of the gossip algorithm d!2t with respect to parameter e. 



B. Convergence Speed versus Parameter e 

We have seen that a sufficiently small parameter e ensures convergence of both algorithms d3) and 
(fT2l) . Now we investigate the influence of e on the speed of convergence, specifically the convergence 
factors \ 2 and Arf . To reduce the effect of network topology in this investigation, we employ a type of 
random digraphs where an edge between every pair of nodes can exist with probability 1/2, independent 
across the network and invariant over time; we take only those that are strongly connected. 

For the deterministic algorithm ((3), consider random digraphs of 50 nodes and uniform weights a = 
b = 1/50. Fig. [6] displays the curve of convergence factor A2 with respect to the parameter e, each 
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plotted point being the mean value of X 2 over 100 random digraphs. To account for the trend of this 
curve, first recall from the perturbation argument for Theorem [Q that the matrix M in © has two 
(maximum) eigenvalues 1 when e = 0, and small e causes that one of them (denote its modulus by 
Xin) moves into the unit circle. Meanwhile, some other eigenvalues of M inside the unit circle move 
outward; denote the maximum modulus among these by \ ou t- In our simulations it is observed that when 
e is small, X 2 = Aj n (> X ou t) and Aj n moves further inside as perturbation becomes larger; so X 2 
decreases (faster convergence) as e increases in the beginning. Since the eigenvalues move continuously, 
there exists some e such that Aj n = X ou t, corresponding to the fastest convergence speed. After that, 
A 2 = X ou t (> Aj n ) and X ou t moves further outside as e increases; hence X 2 increases and convergence 
becomes slower, and finally divergence occurs. 

An analogous experiment is conducted for the gossip algorithm (IT2T >. with random digraphs of 30 
nodes, uniform probability p = l/card(£), and uniform weight u>ij = 1/2. We see in Fig. [7] a similar 
trend of X 2 as the parameter e increases, though it should be noted that the changes in X 2 are smaller 
than those in X 2 • From these observations, it would be of ample interest to exploit the values of e when 
the convergence factors achieve their minima, as well as the upper bounds of e ensuring convergence. 

VII. Conclusions 

We have proposed distributed algorithms which enable networks of agents to achieve average consensus 
on arbitrary strongly connected digraphs. Specifically, in synchronous networks a deterministic algorithm 
ensures asymptotic state averaging, and in asynchronous networks a gossip algorithm guarantees average 
consensus in the mean-square sense and with probability one. To emphasize, our derived graphical 
condition is more general than those previously reported in the literature, in the sense that it does 
not require balanced network structure; also, the matrix perturbation theory plays an important role in 
the convergence analysis. Moreover, special regular digraphs are investigated to give less conservative 
bounds on the parameter e; and numerical examples are provided to illustrate the convergence results, 
with emphasis on convergence speed. 

For future research, one direction of interest would be to extend the deterministic algorithm © to 
the more realistic scenario of switching digraphs Q{k) = (V, £(&)); namely, the network topology is 
time-varying. If every Q{k), k > 0, is strongly connected, then it is possible to ensure convergence by 
introducing slow switching (e.g., dwell time) as in (5], ||37l . Under the weaker graphical condition that 
digraphs Q(k) are jointly strongly connected (10, E71 ). to verify if average consensus can be achieved 
seems to be more challenging and requires further investigation. 
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On the other hand, in the literature on gossip algorithms |fj]> Q, ll38l . a variety of practical com- 
munication issues have been discussed such as link failure, message collision, broadcast protocol, and 
synchronized node selection (i.e., multiple nodes are selected at the same time). We thus aim at addressing 
these issues by making suitable extensions of our gossip algorithm (fl2T l. 
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